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Capitalizing  on  Failure  Through  Case«Basod  Inference* 


Janot  L  Kolodnar 


1.  Introduction 

Over  the  past  several  years,  there  has  begun  to  be  a  great  deal  of  Interest  In  case-based  and  analogical  reasoning 
(e.g.,  Alterman,  1986,  Ashley,  1986,  Carbonell,  1983,  1986,  Hammond,  1986,  Holyoak,  1984,  Kolodnar,  at  al..  1984,  1985, 
R  las  land,  1986,  Simpson,  1985).  Case-based  reasoning  Is  a  problem  solving  method  In  which  previous  reasoning  experi¬ 
ences  are  used  directly  to  solve  a  new  problem,  rather  than  solving  the  problem  from  scratch  using  generalized  methods. 
The  major  advantages  of  a  case-based  approach  are  that  It  can  provide  shortcuts  In  problem  solving  and  that  It  can  help  a 
reasoner  avoid  repeating  previously-made  mistakes. 

We  shall  see  that  previous  failures  serve  several  purposes  during  problem  solving.  They  can  provide  warnings  of  the 
potential  for  failure  in  the  current  case,  and  they  may  also  provide  suggestions  of  what  to  do  Instead.  Analyzing  the  poten¬ 
tial  for  failure  in  a  new  case,  a  necessary  part  of  capitalizing  on  an  old  failure,  may  require  the  problem  solver  to  gather 
additional  Information,  thus  causing  the  problem  solver  to  change  Its  focus  of  attention.  A  previous  tailed  case  that  was 
finally  solved  correctly  can  help  the  problem  solver  to  change  its  point  of  view  In  Interpreting  a  situation  If  that  Is  what  is 
necessary  to  avoid  potential  failure. 

We  shall  illustrate  the  processes  involved  In  capitalizing  on  failure  using  examples  from  two  domains:  common-sense 
mediation  of  everyday  disputes  and  menu  planning.  Case-based  resolution  of  common-sense  disputes  Is  Implemented  In 
the  MEDIATOR  (Kolodnar,  et  al.,  1985,  Simpson,  1985),  an  early  case-based  reasoning  program.  JULIA  (Cullingford  & 
Kolodnar,  1986)  interactively  solves  problems  In  the  catering  domain.  The  processes  that  capitalize  on  failure  are  Imple¬ 
mented  In  JULIA. 

*  This  work  is  supported  "  pan  by  NSF  under  Grant  No.  1ST -8317711  and  Grant  No.  IST-8808362,  by  ARO  under 
Contract  No.  DAAG29-85  K  0023,  and  by  ARI  under  Contract  No.  MDA-903-86-C-173.  Programming  ot  the  examples, 
and  much  work  on  analog  ca!  reasoning  that  la  Incorporated  Into  JULIA'S  case-based  reasoner  was  provided  by  Hong 
Shinn.  Discussions  with  ore-  members  of  the  Al  Group,  past  and  present,  have  also  been  useful. 
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2.  Background 


In  the  simplest  case,  making  a  case-based  Inference  Involves  the  following  steps:* 

1.  Recall  a  relevant  case  from  memory 

2.  Determine  which  parts  of  that  case  are  appropriate  to  make  the  necessary  problem  solving  decision  for  the  new  case 
(l.e.,  focus  on  appropriate  parts  of  the  previous  case) 

3.  Achieve  the  targeited  problem  solving  goal  for  the  new  case  by  making  an  Inference  based  on  the  old  case 

4.  Check  the  consistency  of  what  Is  derived  In  step  3  to  the  new  case 

Consider,  for  example,  tne  following  case: 


Avocado  Dispute  1 

A  problem  solver  Is  attempting  to  resolve  a  dispute  over  possession  of  an  avocado.  Two  people  want  It.  The 
problem  solver  is  attempting  to  All  In  the  underlying  goals  of  the  disputants  (l.e.,  why  does  each  want  the  avo¬ 
cado?).  It  Is  reminded  of  a  dispute  In  which  two  kids  wanted  the  same  candy  bar.  They  both  wanted  to  eat  the 
candy  bar,  and  the  rea sorter  compromised  by  dividing  the  candy  bar  equally  between  them,  having  one  divide  It 
and  the  other  choose  his  half  first. 

The  problem  solver  has  air  aady  boen  reminded  of  another  case  (step  1).  Because  the  problem  solver's  goal  le  to  Infer  the 
underlying  goals  of  the  disputants  In  the  avocado  case,  it  focuses  on  the  underlying  goals  of  the  disputants  In  the  candy 
dispute  (step  2).  They  both  had  the  goal  of  eating  the  whole  candy  bar.  This  goal  was  Inferred  through  a  dmfault-uam 
Inference.  The  reasoner  makes  the  case-based  inference  that  the  disputants  In  the  avocado  dispute  also  want  to  eat  the 
disputed  object  (l.e.,  tne  avocado)  (step  3).  Because  this  hypothesis  is  consistent  with  what  Is  already  known  about  the 
case  (step  4),  the  representation  of  the  case  Is  updated  to  Include  this  Inferred  knowledge. 

When  a  recalled  case  resulted  in  failure,  however,  reasoning  Is  not  as  straightforward.  Consider,  for  example,  the  fol¬ 
lowing: 


Avocado  Dispute  2 

A  problem  solver  <s  attempting  to  resolve  a  dispute  over  possession  of  an  avocado.  Two  people  both  want  It. 
The  problem  solve'  is  trying  to  Infer  the  underlying  goals  of  the  disputants.  This  time  It  Is  reminded  of  a  case 
where  two  sisters  both  wanted  the  same  orange.  The  problem  solver  In  that  case  Inferred  the  sisters'  goals  by 
using  a  dalauit-usn  inference  to  Infer  that  both  disputants  wanted  to  eat  the  orange.  It  turned  out,  however,  that 
the  goal  of  one  ot  the  disputants  was  to  use  the  peel  of  the  orange  to  bake  a  cake.  The  dafault-uaa  Inference 
applied  to  the  orange  as  a  whole  led  to  selection  of  the  wrong  plan  for  resolution  of  the  conflict,  and  the  plan 

*  Each  of  these  step*,  of  course,  le  a  complicated  process.  For  mors  Information  about  step  1,  see  Kolodner  (1983, 

1984),  Hammond  (1988),  Ho  yoak  (1984),  Schenk  (1982);  about  slap  2,  see  Kolo drier,  et  al.  (1985),  Simpson  (1985); 
for  step  3,  see  Alterman  (1886),  Ashley  (1988),  Carbonell  (1983,  1988),  Hammond  (1988),  Kolodner  (1985,  1986), 

Kolodner  at  al.,  (1985),  Riss  and  (1986),  Simpson  (1985);  for  step  4,  see  Simpson  (1985). 


tailed.  We  shall  call  this  part  of  the  case  oranga-dlaputa-f. 


The  problem  solver  reinterpreted  the  dispute  and  solved  It.  The  goals  of  the  slaters  were  amended:  one  wanted 
possession  of  the  fruit  of  the  orange,  the  other  Its  peel.  Their  underlying  goals  were  also  amended:  one  wanted 
to  satisfy  hunger  by  eating  the  fruit,  the  other  wanted  to  bake  with  the  peel.  It  finally  resolved  the  problem  by 
dividing  the  orange  in  a  better  way.  One  sister  was  given  the  fruit  and  the  other  was  given  the  peel.  We  shall 
call  this  part  of  the  case  oranga-dlaputa-a. 

The  problem  solves  also  analyzed  its  failure  In  oranga-dlaputa-f,  and  added  Its  analysis  to  Its  memory  of  that 
case:  Failure  was  due  to  a  wrong-goal  Infaranca.  Datault  use  applied  to  the  entire  disputed  ob|ect  (orange) 
resulted  In  failure,  while  dafault  uaa  applied  to  parts  of  the  orange  (the  peel  and  the  fruit)  would  have  resulted  In 
success. 

Suppose  now  that  the  problem  solver  Is  reminded  of  oranga-diaputa-f,  the  case  that  resulted  In  failure.  This  case  acts  as  a 
warning  to  the  problem  solver  of  the  potential  to  make  a  faulty  Inference  In  the  current  case.  It  must  check  to  see  If  the 
Inference  used  previously  would  also  result  In  error  In  the  current  case.  The  question  that  must  be  asked  of  the  avocado 
dispute  based  on  analysis  of  the  orange  dispute  Is  whether  an  avacado  also  has  parts  used  for  different  purposes  that 
might  predict  the  goals  of  the  current  disputants  better  than  If  they  were  computed  by  applying  dafault-uaa  to  the  whole 
avacado.  In  other  words,  based  on  Its  reminding  of  oranga-dlaputa-f,  which  failed,  case-based  reasoning  alerts  the  rea- 
aoner  to  the  fact  that  it  me  disputed  object  has  several  parts,  the  goals  of  the  disputants  may  have  something  to  do  with  the 
parts  and  not  necessarily  with  the  avocado  as  a  whole.*  The  potential  for  failure  le  flagged  and  two  alternative  sdutlone  are 
presented. 

Errors  in  reasoning  can  happen  during  any  problem  solving  step.  The  problem  might  have  been  misunderstood  Ini¬ 
tially,  resulting  In  incorrect  classification  of  the  problem  or  Incorrect  Inferences  during  the  problem  elaboration  phase.  Since 
problem  understanding  <s  an  early  part  of  the  problem  solving  cycle,  such  misunderstandings  and  incorrect  Inferences  pro¬ 
pagate  through  to  the  planning  phase,  resulting  In  a  poor  plan.  A  problem  might  be  understood  correctly  and  all  the  necee- 
aary  details  known  about  it,  but  might  still  be  solved  incorrectly  because  poor  decisions  were  made  while  planning  a  solu¬ 
tion.  In  general,  such  w-ors  are  due  to  faulty  problem  solving  knowledge.  The  problem  solver  might  not  have  complete 
knowledge,  for  example,  about  under  what  circumstances  a  particular  planning  policy  or  plan  step  la  appropriate.  Finally,  a 
problem  might  be  solved  correctly  but  carried  out  Incorrectly  by  the  agent  carrying  out  the  plan,  or  unexpected  cir¬ 


cumstances  might  cause  execution  to  fall.  Reminding  of  a  case  where  any  of  these  things  happened  warns  the  the  problem 

•  H  may  be  judged  In  in  a  case  that  Inference  based  on  the  parts  is  inappropriate  (since  one  rarely  plants  avocado 
seeds). 
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solvar  of  the  potential  for  the  same  type  of  error  In  the  new  case.  If  the  previous  case  was  finally  resolved  correctly,  details 
of  its  correct  resolution  suggest  correct  decisions  for  the  current  case. 


3.  tome  Problem  Solving  Assumptions 

Before  presenting  the  set  of  processes  that  capitalizes  on  previously-failed  cases,  we  briefly  present  the  relevant 
parts  of  our  problem  solving  paradigm.  First,  when  we  refer  to  problem  solving,  we  Include  the  entire  cycle  of  understand¬ 
ing  a  problem  and  eiabo'ating  Its  features,  coming  up  with  a  plan  for  Its  solution,  executing  that  plan,  analyzing  the  results, 
and  If  necessary,  going  back  to  the  beginning  and  trying  again.  Our  own  previous  work  (Kolodner,  et  al.,  1085,  Simpson, 
1985)  and  that  of  others  (e  g.,  Hammond,  1986)  has  shown  that  case-based  Inference  can  be  used  for  a  variety  of  tasks 
during  any  of  these  problem  solving  phases. 

The  second  important  assumption  of  our  paradigm  Is  that  memory  access  and  problem  solving  are  happening  in 
parallel  (Kolodner,  1985,  Kolodner  &  Culilngford,  1986).  The  memory's  job  Is  to  Integrate  the  case  that  Is  currently  being 
reasoned  about  into  the  momory  that  already  exists  (Schank,  1982),  resulting  In  remindings.  Memory  can  return  generalized 
knowledge  (e  g.,  knowledge  structures  or  rules)  for  the  problem  solver  to  use  or  a  previous  case  that  Is  similar  to  what  the 
problem  solver  is  currently  dealing  with.  As  the  problem  and  Its  solution  are  further  elaborated,  memory  la  able  to  recall 
both  more  relevant  general  knowledge  and  better  related  cases  for  the  problem  solver  to  use. 

Our  third  important  assumption  is  that  case-based  reasoning  is  happening  In  the  context  of  a  set  of  reasoning  goals 
and  that,  In  addition  tc  me  case-based  reasons: ,  other  reasoners  are  also  keeping  track  of  those  goals  and  making  any 
suggestions  they  can  (Kolodner,  1987).  Thus,  In  addition  to  the  case-based  reasoner,  a  problem  reduction  problem  solver 
might  be  available  to  break  the  problem  Into  smaller  parts,  while  a  constraint  propagator  might  do  forward  chaining  infer¬ 
ences,  and  a  truth  maimenance  system  might  be  checking  for  Inconsistencies  and  constraint  violations.  Something  we'll  call 
the  overall  problem  sever  keeps  track  of  reasoning  goals  and  subgoals  as  they  come  up,  and  each  of  the  reasoners 
watches  the  goal  network  and  attempts  to  achieve  any  goal  It  can. 

Finally,  the  processes  we  present  below  assume  that  reminding  has  been  of  the  failed  part  of  a  case  that  might  have 
been  resolved  correctly  ater.  In  the  case  of  the  orange  dispute,  for  example,  we  assume  reminding  has  been  of  the 
episode  that  failed,  orange- dispuf-f.  Reminding  during  problem  solving  may  be  of  either  the  successful  or  the  failed 
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version  of  any  case.  When  reminding  is  of  the  successful  Instance  of  solving  It,  the  faulty  reasoning  that  proceeded  the  suc- 
ceesful  solution  is  bypassed  and  a  good  solution  Is  suggested  Immediately.  The  problem  solver  Is  never  alerted  to  possible 
problems.  Only  when  reminding  Is  of  a  failed  attempt  at  resolving  a  case  Is  the  problem  solver  alerted  and  the  analysis 
deecrfced  below  done. 


4.  The  Process 

Given  this  set  of  assumptions,  we  see  that  the  problem  solver  might  be  reminded  of  a  previous  case  that  resulted  In 
failure  any  time  during  problem  solving.  Because  of  this,  the  processes  that  capitalize  on  previous  failures  must  be  applica¬ 
ble  during  any  part  of  the  problem  solving  cycle.  The  following  set  of  steps  are  executed  any  time  during  problem  solving 
that  a  failed  case  Is  recalled. 

1.  Determine  whether  the  failed  case  was  ever  followed  up  on,  and,  If  so,  recall  the  entire  reasoning  sequence  that 
followed  It. 

This  step  makes  alternatives  that  were  attempted  previously  to  solve  the  recalled  problem  available  to  the  problem  solver. 

In  the  representation  we  are  currently  using,  each  full  analysis  of  a  problem  Is  kept  separately  with  pointers  between 
them.  Thus,  the  representation  for  a  case  that  failed  and  was  reanalyzed,  such  as  the  orange  dispute,  Is  actually 
represented  as  two  cases.  The  first  Is  the  one  that  failed  ( prang  e-diapute-f ),  where  one  set  of  assumptions  was  made 
about  the  goals  of  the  disputants.  That  one  includes  the  mistaken  problem  description,  the  suggested  plan  (cut  It  In  half), 
feedback  after  suggesting  or  carrying  out  that  plan  (after  suggesting  that  the  orange  be  cut  in  half),  and  the  analysis  of  what 
went  wrong  (a  wrong-  goai-interence).  The  first  (failed  episode)  also  Includes  a  pointer  to  the  next  problem  solving 
episode,  i.e.,  the  reasoning  that  is  carried  out  to  solve  the  problem  after  the  failures  of  the  first  episode  have  been  diag¬ 
nosed  and  repaired.  Thus,  orange-dlspute-l  points  to  orange-disputes,  where  the  problem  Is  described  as  one  where  the 
disputants  have  the  second  set  of  goals,  and  the  solution  plan  that  goes  with  that  (divide  agreeably)  Is  recorded. 

2.  Recall  or  deter  mine  what  was  responsible  for  the  previous  failure. 

In  some  instances,  responsibility  for  failure  will  already  have  been  attrbuted  during  previous  reasoning.  In  that  case,  this 

step  is  an  easy  step  of  retrieving  the  error  attribution  from  the  representation  of  the  case.  In  other  instances,  there  might 

not  have  been  any  analysis  of  why  the  previous  problem  occured.  When  this  happens,  It  Is  appropriate  for  the  problem 

solver  to  try  to  figure  out  why  the  previous  error  happened.  We  do  not  go  Into  that  process  in  this  paper.* 

*  If  responsibility  tor  failure  s  not  known  at  the  end  of  this  step,  It  is  still  possible  to  capitalize  on  the  failure. 


In  general,  failures  happen  because  some  Inference  was  made  Incorrectly  or  not  made  at  all.  This  might  be  due  to 
faulty  or  missing  Information  about  the  problem  Itself,  or  faulty  or  Incomplete  problem  solving  knowledge.  An  analysis  of  a 
failure  may  record  only  which  inference  was  made  incorrectly  or  was  not  made,  or  it  may  record  the  reasons  why  the  Infer¬ 
ence  was  made  Incorrectly.  As  we  shall  see,  the  better  an  analysis  of  a  previous  failure  Is,  the  more  the  problem  solver  will 
be  able  to  capitalize  on  tne  failure.  The  best  analysis  of  a  failure  will  record  reasons  for  faulty  reasoning  ail  the  way  back  to 
a  point  in  the  reasoning  where  it  could  have  been  corrected,  l.e.,  where  the  missing  or  faulty  information  can  be  obtained  or 
fixed.  For  example,  failure  in  oranga-dlaputa-f  can  be  traced  to  a  wrong-goal  Intaranca.  The  goals  were  Inferred 
Incorrectly.  The  reason  for  this  is  that  dalault-uaa  was  applied  to  the  wrong  object  (l.e.,  to  orange  as  a  whole  rather  than 
the  parts  of  the  orange) .  The  reason  for  this  Is  that  the  problem  solver  was  viewing  the  orange  in  the  wrong  way:  as  a 
whole  rather  than  as  a  tning  with  functional  parts.  If  the  reasons  for  this  inference  error  are  recorded  to  thle  level,  then  by 
using  this  case  and  following  the  set  of  steps  to  be  presented,  the  problem  solver  will  be  able  to  consider  whether  some 
other  object  might  be  boner  viewed  as  a  thing  with  functional  parts.  If  only  the  fact  that  the  goal  was  Inferred  Incorrectly 
were  recorded,  it  would  not  have  as  much  to  go  on,  but  would  only  be  able  to  consider  If  there  is  another  goal  associated 
with  the  object. 

3.  Determine  tne  relationship  of  the  decision  currently  being  focussed  on  to  the  previous  failure  and  refocus  as 

required: 

(a)  Was  tne  decision  analogous  to  the  one  the  problem  solver  is  currently  trying  to  make  responsible  for  the 
failure?  If  so,  maintain  current  problem  solving  focus. 

(b)  If  not.  was  the  decision  analogous  to  the  one  the  problem  solver  Is  currently  trying  to  make  dependent  on 

the  one  responsible  for  the  failure,  or  alternatively,  did  the  value  the  problem  solver  Is  currently  attempting 

to  derive  change  In  the  final  solution  to  the  problem?  If  so,  refocus  the  problem  solver  on  the  decision 
analogous  to  the  one  that  was  responsible  for  the  previous  failure. 

(c)  If  not.  then  refocus  as  In  (b)  to  be  careful  or  maintain  current  focus  to  be  fast. 

When  the  decision  the  p'oblem  solver  Is  currently  trying  to  make  was  responsible  for  the  previous  failure  (l.e,  the  answer  to 

3(a)  is  yes),  then  more  effort  must  go  Into  making  that  decision.  This  Is  the  case  in  avocado  dlsputa  2.  The  problem 

solver  has  the  goal  of  inferring  the  goals  of  the  disputants,  and  it  was  this  decision  that  was  responsible  for  the  failure  In 

oranga-dlapute-l. 

The  more  Interesting  cases,  however,  Is  when  the  answer  to  3(b)  Is  yes.  In  these  cases,  some  decision  other  than 
the  one  currently  being  attempted  was  responsible  for  the  previous  failure.  The  problem  solver  will  have  to  ratocua  Itself  on 
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that  dec(8k)n,  and  (re) make  it  for  the  current  case  before  continuing.  Consider,  for  example,  the  following: 

Panama  Canal  Dispute 

Both  Panama  and  the  United  States  want  possession  of  the  Panama  Canal  Zone.  The  problem  solver  Is 
attempting  to  figure  out  how  to  classify  the  dispute.  The  problem  solver  Is  reminded  of  the  dispute  between 
Israel  and  Egypt  over  the  Sinai.  Both  wanted  the  Sinai,  and  the  problem  solver  had  originally  classified  It  as  a 
physical  dispute  over  possession  of  the  land.  It  had  therefore  suggested  that  they  cut  It  down  the  middle  and 
share  it.  Both  Israel  and  Egypt  balked.  On  further  analysis,  the  failure  of  this  suggestion  was  tracked  down  to  a 
set  of  missing-goal  inferences.  The  goals  of  Israel  and  Egypt  with  respect  to  the  Sinai  had  not  been  inferred. 

Israel  wanted  military  control  of  the  area  for  security  reasons,  while  Egypt  wanted  possession  of  the  land  itself 
for  reasons  of  national  Integrety.  This  Interpretation  makes  the  dispute  Into  a  political  dispute  rather  than  a  phy¬ 
sical  one,  l.e.,  one  for  which  political  alternatives  are  suggested  rather  than  alternatives  having  to  do  with  the 
physical  object  Used. 

Responsblllty  for  the  failure  In  the  previous  case  (the  Sinai  Dispute)  had  already  been  tracked  down  to  missing  goal  Infer¬ 
ences.  The  problem  solver  Is  currently  attempting  to  decide  what  kind  of  dispute  It  is  (e.g.,  physical  or  political?).  The  ori¬ 
ginal  classification  of  the  Sinai  Dispute  as  a  physical  dispute  was  not  per  se  the  reason  that  solution  failed.  Rather  that 
decision  was  based  on  tne  goals  of  the  disputants,  which  had  been  Inferred  Incorrectly  previous  to  attempting  classification. 
The  physical  classification,  however,  changed  to  political  In  the  final  analysis,  and  was  dependent  on  what  was  responsible 
for  the  failure  in  reasoning  Reminding  of  the  Sinai  Dispute  should  refocus  the  problem  solver  on  the  set  of  decisions  that 
were  responsible  for  its  failure,  namely  inference  of  disputant  goals. 

If  the  decision  be>ng  focussed  on  at  the  beginning  of  this  set  of  steps  was  a  correct  one  for  the  previous  case  and  If  It 
did  not  change  when  the  case  was  reanalyzed  (case  c),  there  is  no  reason  why  the  problem  solver  must  consider  the  previ¬ 
ous  failure  at  all.  However,  a  careful  problem  solver  will  also  consider  whether  that  failure  Is  possible  in  the  current  environ¬ 
ment,  thus  refocusing  itself  on  whatever  caused  the  failure  previously  before  going  on. 

In  cases  where  tne  problem  solver  changes  its  focus,  It  continues  by  trying  to  redo  the  task  that  could  have  been 
made  In  error,  following  tne  set  of  steps  below.  If  the  problem  solver  changes  a  decision  It  had  made  previously,  then  It 
must  also  remake  any  decisions  that  depended  on  It  before  going  on.  After  this  set  of  steps  Is  complete,  the  problem  solver 
must  refocus  appropriately  to  finish  solving  the  problem.  Processing  that  happens  In  the  course  of  recomputing  already- 
made  decisions  may  direct  the  problem  solver  In  different  directions  than  it  had  been  planning  when  it  was  interrupted  by  the 
failed  case.  On  the  otner  hand,  If  there  are  no  other  recomputations  to  be  made  or  If  no  other  problem  solving  directions 
are  suggested,  the  problem  solver  continues  after  this  step  as  It  had  been  planning  originally.  That  Is,  It  goes  back  to  the 


goal  It  was  working  on  when  It  reached  this  step  and  continues  from  there. 


The  processing  that  happens  after  step  3  depends  on  whether  or  not  a  successful  solution  was  ever  found  In  the  pre¬ 
vious  case  and  whether  or  not  analysis  can  be  or  has  been  done  of  the  previous  failure.  If  there  was  neither  a  solution 
found  to  the  previous  p'ooiem  nor  an  explanation  of  the  previous  failure,  then  only  an  analysis  of  the  potential  for  failure  can 
be  contributed  by  the  me  previous  case.  And,  If  there  Is  no  explanation  of  the  failure,  then  less  can  be  contributed  than  if 
there  is  an  explanation.  With  an  explanation,  we  know  what  features  of  the  previous  case  were  responsible  for  the  failure 
and  we  can  check  for  me  presence  of  those  In  the  new  case.  Without  that  explanation,  we  can  use  the  Justifications  for  pre¬ 
viously  made  Inferences  and  see  It  they  hold  In  the  new  case,  but  such  analysis  is  In  a  sense  "superstitious"  since  no 
causal  explanation  available. 

4.  Recall  the  inference  rules  and  justifying  conditions  used  to  Infer  the  focused-on  portion  of  the  failed  case.  IF 
there  was  fonowup,  THEN  also  recall  the  Inference  rules  and  justifying  conditions  used  to  infer  the  focused-on 
portion  of  each  of  the  followup  cases.* 

The  Inference  rules  ano  justifying  conditions  of  any  failed  casee  will  be  used  to  check  for  the  potential  for  failure  In  the 
current  case.  Those  from  the  successfully-resolved  case  will  be  used  to  guide  the  problem  solver  to  a  correct  decision. 

In  the  case  of  omnge-cfispute-f,  the  Inference  rule  used  to  Infer  the  goals  of  the  disputants  was  default-use  applied 
to  the  disputed  object,  it  is  justified  by  Its  preconditions,  l.e.,  there  Is  an  object  of  current  Interest  (the  orange)  that  has  a 
default  use  (eating).  It  might  also  have  been  justified  by  its  use  previously  In  the  candy  dispute,  where  It  worked  fine.  For 
orenge-dlspute-8,  there  were  two  Inference  rules  used  to  infer  the  goals  of  the  disputants.  In  one  case,  default-use  was 

applied  to  the  fruit  of  the  orange,  In  the  other  It  was  applied  to  the  peel  of  the  orange.  The  fruit  and  peel  of  the  orange  are 

Its  major  parts  and  each  are  used  for  different  purposes. 

5.  Check  to  see  if  there  is  the  same  potential  for  failure  in  the  new  case.  This  Is  done  by  a  variety  of  methods. 

We  list  two  here. 

(a)  Check  the  reason  why  the  reasoning  error  was  made  in  the  first  case.  An  error  can  be  made  because  of 
Incomplete  information,  because  of  faulty  Information,  because  of  a  faulty  Inference  rule,  or  because  of 
faulty  focus  (which  might  Itself  be  tracked  down  to  one  of  these  causes). 

(b)  Determine  if  the  justifying  Inference  rules  and  conditions  from  the  failed  and  successful  casee  also  hold  in 
the  new  case. 

Let  us  consider  (a)  first.  This  is  the  way  we  determine  potential  for  failure  in  a  new  case  If  we  know  why  the  previously- 

made  decision  failed,  if  a  previous  reasoning  error  was  made  because  of  lack  of  knowledge,  the  appropriate  knowledge  is 

*  Recall  that  the  problem  solver  might  have  refocused  its  goal 9  in  the  last  step,  eo  the  portion  of  the  case  being 
focused  on  now  might  nol  oe  ire  one  originally  considered. 
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now  sought  for  the  currant  case.  If  It  was  because  of  faulty  Information,  this  step  will  require  clarification  of  the  analogous 
knowledge  In  the  new  case.  If  it  was  because  of  a  faulty  inference  rule,  that  rule  will  be  ruled  out  In  this  case.  And  If  It  was 
because  of  faulty  focus  (probably  due  to  one  of  the  other  types  of  error),  a  suggestion  will  be  made  from  tne  previous  case 
of  where  to  focus  In  the  new  case.  Analyzing  the  orange  dispute  using  this  step,  we  find  that  the  reason  for  the  wrong- 
goal-inference  was  faulty  focus.  Focus  had  been  on  the  orange  as  a  whole  while  It  should  have  been  on  Its  functional 
parts.  The  suggestion  is  thus  made  to  focus  on  the  functional  parts  of  the  avacado,  rather  than  the  avacado  as  a  whole  In 
inferring  the  goals  of  the  disputants  with  respect  to  the  avacado.  As  In  the  analysis  of  the  orange  dispute  from  above,  in  the 
next  steps,  the  reasoner  will  either  ask  the  disputants  which  parts  of  the  avacado  they  are  interested  In  or  will  decide  that 
the  only  functional  part  that  Is  worth  considering  is  the  fruit. 

When  there  is  no  knowledge  about  why  a  previously-made  decision  was  In  error,  the  beet  that  can  be  done  Is  to 
evaluate  whether  conditions  that  led  to  that  decision  are  also  present  in  the  current  case.  This  Is  case  (b).  These  condi¬ 
tions  can  be  found  in  the  justifications  for  the  value  that  was  computed  previously.  If  Justifications  of  both  the  failed  and  the 
successful  decision  are  applicable  In  the  new  case,  an  evaluation  must  be  done  of  which  is  best.  In  orange-dlspute-f,  for 
example,  the  goals  of  each  disputant  were  computed  using  a  default-use  Inference  applied  to  the  disputed  object.  Justifica¬ 
tion  for  the  default- use  inference  comes  from  Its  antecedent  clause,  which  asks  whether  there  Is  some  major  default  use  for 
the  object  In  question  that  has  an  "obvious"  goal  associated  with  It.  An  orange  and  an  avocado,  of  course,  both  have  th6 
same  default  use  (eating)  and  "obvious"  goal  (satisfy  hunger).  In  orange-dlspute-s,  the  goals  of  each  disputant  were  com¬ 
puted  using  a  default-use  inference  applied  to  the  functional  parts  of  the  disputed  object.  Justification  tor  this  application  of 
this  inference  rule  is  a  combination  of  the  justification  for  choosing  the  objects  to  be  focussed  on  (the  disputed  object  has 
functional  parts)  and  the  antecedent  clause  of  default-use  applied  to  each  of  those  parts. 

Using  the  orange  dispute  as  a  model  for  the  avocado  dispute,  Justifications  for  each  of  the  goal  decisions  made  In 
resolving  that  dispute  are  evaluated  with  respect  to  the  avocado  dispute.  Since  the  avacado  has  a  default  use  (eating),  the 
Inference  from  orange-dispute-t  can  be  made.  Since  it  also  has  parts  with  default  uses  (the  fruit  Is  eaten  while  the  seed 
can  be  planted),  the  inferences  from  orange-dispute-a  can  also  be  made.  In  this  case,  further  evaluation  Is  needed  to 
determine  which  way  to  make  the  Inference.  While  case-based  reasoning,  In  this  case,  does  not  provide  an  answer,  It  does 


warn  of  the  potential  for  misinterpreting  the  case  and  it  also  provides  suggestions  of  alternate  interpretations.  It  thus  acts  as 


a  preventive  measure  to  aid  In  avoiding  failure. 

It  !e  Interesting  to  note  that  the  knowledge  neceesary  to  do  the  computations  Just  desorbed  may  not  yet  have  been 
considered  (e  g.,  the  problem  solver  may  not  have  considered  If  an  avacado  has  parts  used  for  different  purposes).  Some¬ 
times,  gathering  appropriate  knowledge  consists  of  fusl  an  easy  question  to  the  user.  In  some  cases,  however,  answering 
the  questions  posed  In  tn.s  set  of  steps  may  require  significant  reasoning.  This  extra  computation,  while  significant,  is  done 
only  when  a  previous  uat  points  to  the  need  to  look  out  for  a  problem.  As  we  stated  previously,  It  Is  a  preventive  aid  In 
avoiding  failure. 

The  output  of  thib  step  le  an  evaluation  of  whether  the  previous  failure  could  happen  In  the  new  case,  and  If  the  pre¬ 
vious  case  was  solved  successfully,  an  evaluation  of  whether  the  previous  successful  solution  Is  applicable  to  the  new  case. 

Based  on  these  two  evaluations,  the  reasoning  continues. 

6. 

(a)  If  the  previous  failure  will  not  repeat  Itself  In  the  new  case,  go  on  with  the  problem  solving.  The  (failed)  sugges¬ 
tion  from  me  previous  case  can  be  transferred  to  the  new  case  If  there  is  some  Independent  reason  that  it  can 
be  supported  or  or  a  decision  can  be  made  Independent  of  the  recalled  case. 

(b)  If  the  previous  failure  could  repeat  Itself  In  the  new  case,  rule  out  the  inference  rule  or  value  used  previously  for 
the  new  case. 

(c)  If  the  previous  successful  solution  Is  fudged  applicable  to  the  new  case,  use  It  and  apply  case-based  reasoning 
methods  to  derive  a  value  for  the  new  case  based  on  It. 

(d)  if  the  previous  successful  solution  or  any  of  the  Interim  solutions  from  the  previous  problem  are  fudged  Inappli¬ 
cable  to  the  new  problem,  rule  them  out  for  the  new  case. 

(e)  If  both  the  tailed  and  successful  solutions  to  the  previous  problem  are  fudged  applicable  to  the  new  one,  use 
some  decision-making  procedure  to  decide  between  them. 

8.  Case-Based  Inference  in  JULIA 


In  the  following  problem  solving  session,  we  see  JULIA  following  the  set  of  steps  above  to  capitalize  on  a  previous 
problem  solving  failure.  JULIA  (Culllngford  &  Kolodner,  1986,  Kolodner,  1987)  Is  designed  to  be  an  automated  colleague 
whose  task  is  to  help  a  caterer  design  a  meal.  JULIA'S  problem  solving  components  Include  a  case-based  reasoner,  a 
problem  reduction  planner,  a  constraint  propagator,  and  a  reason -maintenance  system.  It  also  has  a  memory  for  events. 
Each  decision  JULIA  makes  when  it 's  solving  a  problem  Is  recorded  along  with  the  Justifications  for  the  decisions.  Thus,  In 

later  problem  solving,  tnose  justifications  are  available  to  use  In  case-based  reasoning.*  In  the  first  case-based  reasoning 

*  See  Kolodner  (1986)  (O'  a  description  of  the  representational  support  for  these  processes,  especially  the  content  and 
tfructixe  of  the  justilicat  o-s  JULIA  maintains.  Kolodner  (1987)  describes  the  Interactions  between  the  different 


example,  we  see  JULIA  using  a  previous  case  to  avoid  serving  a  spicy  Mexican  meal  to  people  who  donl  eat  spicy  food. 
The  previously-failed  case,  which  failed  because  of  a  lack  of  this  Information,  causes  JULIA  to  gather  the  appropriate  Infor¬ 
mation  In  the  new  case,  thus  letting  It  plan  for  these  people  Immediately.  This  makes  JULIA  retract  two  previously-made 
decisions  (the  entree  and  the  cuisine).  JULIA  refocuses  itself  on  the  cuisine,  retracts  and  remakes  that  decision,  and  contin¬ 
ues  with  its  problem  solving. 


The  dialog  begins  with  JULIA  Introducing  Itself  and  the  user  stating  her  problem.  We  state  the  problem  In  English 

here.  Actual  input  for  tnis  problem  Is  a  conceptual  representation. 

<JULIA>  Hello.  I’m  JULIA,  a  Caterer’s  Advisor.  May  I  help  you? 

USER  => 

I’m  having  a  dinner  next  week  for  my  research  group. 

There  is  no  room  for  all  of  them  In  the  dining  room. 

<JULIA> 

***  The  Initial  problem  is: 

. Frame  #<FRAME  3450203 2>  ***** 

Name:  M-MEAL774 
Isa:  (<M-MEAL>) 

Category:  INDIVIDUAL 
Slots: 

ACTUAL-RESULT.  NIL 

CHARACTERS:  (?HOST  7GUESTS  7PARTICIPANTS) 

CONSTRAINTS:  (<C-LIMITED-SPACE770>) 

DEFINED-SLOTS:  NIL 
DESCRIPTOR:  ML 
EXPECTED-RESULT:  NIL 
FOLLOW-UP:  NiL 

GOALS:  (<E-EAT776>  <S-HUNGER777>) 

GUESTS:  <*JLK  S-GROUP> 

HOST:  <*JLK*> 

ORDER:  NIL 

PARTICIPANTS:  ( ’MOST  7GUESTS) 

SETTING:  <*JL*’S-HOUSE> 

STEPS:  NIL 
TIME:  NIL 

JULIA'S  problem  reduction  problem  solver  starts  out.  It  immediately  reduces  the  Instantlate-a-meal  task  to  Its  component 
parts  and  begins  working  on  the  first  of  them,  the  meal  descriptor  task.  Meal  descriptors  Include,  among  other  things,  the 
meal’s  cuisine. 

*****  Planning  for  the  task  MEAL-TASK775  . 


procstSM. 


TASK-TREE  =  ((<MEAL-TASK775>)) 


The  active  goal  chain  is  (  M-MEAL  ) 

Reducing  the  task  MEAL-TASK775  to  subtasks  (<MEAL-DESCRIPTOR-TASK> 
<MAIN-COURSE-TASK>  < APPETIZER-TASK >  <SALAD-TASK>  <DESSERT-TASK>) 


Planning  tor  the  las*  MEAL-DESCRIPTOR-TASK 


TASK-TREE  =  ((<ME  al-DESCRIPTOR-TASK>  <MAIN-COURSE-TASK>  <APPETIZER-TASK> 

<SALAD-T aSk>  <DESSERT -TASK>)  (<MEAL-TASK775>)) 

The  active  goal  chain  is  (  MEAL-DESCRIPTOR  <=  M-MEAL  ) 

As  part  of  this  task,  JULIA  attempts  to  formulate  a  cuisine,  but  cant  do  It  with  the  Information  supplied  so  far  by  tha  user, 
so  It  asks. 

Constraint  Satisfaction . 

Checking  constraints  'or  slot  CUISINE  of  MEAL-DESCRIPTOR783  ... 
instantiating  slot  CUIS'NE  of  frame  MEAL-DESCRIPTOR783  ... 

<JULIA>  What  cuisine  would  you  Ike? 

USER  =>  mexican 
<JULIA> 

Constraint  Satisfaction . 

Checking  constraints  'or  slot  CUISINE  of  MEAL-DESCRIPTOR783  ... 

Instantiating  slot  CUIS'NE  of  frame  MEAL-DESCRIPTOR783  ... 

~>  The  value  Is  MEXiCAN-CUISINE 

JULIA  goes  on  to  Its  nu«t  task,  choosing  a  main  course,  and  suggests  chili  for  the  main  course  (we  leave  out  the  way  It  did 
that).  At  that  point,  it  is  eminded  of  a  meal  in  which  chili  was  served.  If  this  meal  had  been  a  successful  one,  the  remind¬ 
ing  would  provide  suggestions  about  other  parts  of  the  meal.  In  this  case,  however,  some  guests,  who  did  not  eat  hot 
food,  were  left  unsatisfied. 

*****  Planning  for  the  task  MAIN-COURSE-TASK . 

TASK-TREE  =  ((<MaiN-COURSE-TASK>  <APPETIZER-TASK>  <SALAD-TASK> 

<DESSERT-TASK>)  (<MEAL-TASK775>)) 

The  active  goal  chain  is  (  SC-MAIN-COURSE  <=  M-MEAL) 

<JULIA>  What  about  CHILI791  for  the  main  course? 

USER  =>  ok 
<JULIA> 

*****  Reminded  of  MEAL80,  where  chill  was  the  main  course 

*****  Case-based  reasoning  with  the  case  MEAL80 

***  Trying  to  do  analogy  mapping  with  the  case  MEAL80  ... 

Checking  If  the  previous  plan  for  goals  S-HUNGER80  E-EAT80  was  successful . 

Previous  plan  execution  failure  found 
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The  set  of  goals  failed  was  S-HUNGER80  E-EAT80 
It  was  because  ((NOT  EVERY  ONE  ATE  SPICY  DISH)) 

JULIA  will  try  to  avoid  maxing  this  mistake  again.  It  finds  (through  looking  at  the  representation  of  the  previous  case)  that 
the  previous  failure  was  because  of  a  missing  constraint  about  spices  and  seeks  to  find  out  If  this  constraint  should  be  taken 
Into  account  in  the  current  case.  After  asking,  it  finds  that  to  be  so  and  creates  a  a  "non-eplcy-food"  constraint  for  the 
current  case.  It  propagates  that  constraint  and  checks  It  against  what  It  has  already  decided.  It  finds  out  that  chill  and  Mex¬ 
ican  food  are  spicy,  ana  rules  both  out.  Because  choosing  a  main  course  Is  dependent  on  having  a  value  for  cuisine,  It 
deletes  the  choose-a-main -course  task  from  the  task  network,  reschedules  the  meal-descrlptor  task  and  the  choose-a- 
ma  In -course  task,  and  attempts  the  meal-descrlptor  task  again  In  an  effort  to  choose  a  culslrte. 

**•  Attempting  to  avoid  the  previous  plan  failure . 

The  assigned  blame  was  (hat  C-NON-SPICY-PREF80  had  not  been  considered. 

To  avoid  previous  plan  failure  ... 

Asking  the  user  of  a  missing  constraint  C-NON-SPICY-PREF 
<JULIA>  Is  there  anyone  who  doesn't  Ike  spicy  food?  (How  many?) 

USER  =  >  3 
<JULIA> 

Trying  to  propagate  the  constraint  C-NON-SPICY-PREF793  . 

->  Generating  a  new  constraint  C-NON-SPICY-CUISINE794 
-->  Generating  a  new  constraint  C-NON-SPICY-DISH795 
Applying  constraint  C-NON-SPICY-DISH795  to  CHIU791 
->  Aborting  CHILI791 

Applying  constraint  C-NON-SPICY-CUISINE794  to  MEXICAN-CUISINE 
->  Aborting  MEXICAN-CUISINE 
«>  Killing  the  current  task  MAIN-COURSE-TASK . 

-->  Rescheduling  MEAL-DESCRIPTOR-TASK  MAIN-COURSE-TASK  Into  the  task  network . 

.  Planning  for  the  task  MEAL-DESCRIPTOR-TASK . 

TASK-TREE  =  ((<MEAL-DESCRIPTOR-TASK>  <MA!N-COURSE-TASK>  < APPETIZER -TASK> 

<SALAD-T ASK >  <DESSERT-TASK>)  (<MEAL-TASK775>)) 

The  active  goal  chain  is  (  MEAL-DESCRIPTOR  <  =  M-MEAL  ) 

Constraint  Satisfaction . 

Checking  constraints  for  slot  CU'SINE  of  MEAL-DESCRIPTOR7B3  ... 

-->  Applying  constraint  C-NON-SPICY-CUISINE794  to  slot  CUISINE 
-->  The  slot  CUISine  is  not  yet  filled  In 
Instantiating  slot  CUlSiNE  of  frame  MEAL-DESCRIPTOR783  ... 

Because  there  has  been  little  in  the  way  of  preferences  offered  by  the  user  up  to  now,  JULIA  cannot  suggest  a  new  cuisine 
by  itself  at  this  point.  It  asks  the  user  again  for  a  cuisine  preference,  this  time  telling  the  user  constraints  on  the  preference. 
The  user  suggests  Italian,  and  JULIA  goes  on.  To  complete  the  menu,  JULIA  continues  Its  reasoning,  choosing  lasagne  for 


the  main  course  and  is  reminded  of  a  case  in  which  vegetarians  were  at  a  lasagne  dinner  and  could  not  eat.  JULIA  knows 


that  In  tha  previous  case,  they  could  have  eaten  if  the  meatless  version  of  the  dish  had  been  served,  and  proposes  the 
same  In  this  case.  The  meal  JULIA  finally  comes  up  with  Includes  vegetarian  antipasto  as  the  appetizer,  veggie  lasagne  and 
Italian  bread  for  the  main  course,  mixed  green  salad  as  the  salad,  and  Ice  cream  for  dessert. 

6.  Discussion 

In  our  scheme,  potential  failures  can  be  encountered  and  thus  need  to  be  dealt  with  during  any  step  of  the  problem 
solving.  Any  time  the  problem  solver  encounters  a  case  with  a  previous  problem,  It  considers  whether  there  is  the  potential 
for  that  problem  in  the  new  case.  This  may  cause  it  to  refocus  itself  until  the  potential  for  failure  Is  determined,  and  If  such 
potential  Is  determined  and  the  problem  solver  has  to  retract  decisions  made  previous  to  the  current  one,  then  It  must 
remake  any  decisions  dependent  on  those  decisions.  Such  processing,  of  course,  requires  that  the  problem  solver  be 
integrated  with  a  reason -maintenance  system  that  keeps  track  of  the  dependencies  among  Its  decisions.  Other  steps 
require  that  the  reasons  record  justifications  for  each  of  the  decisions  It  makes.  We  have  not  done  a  greet  deal  of  work  in 
these  areas,  but  our  experience  so  far  leads  us  to  believe  that  a  standard  truth  maintenance  system  (Doyle,  1979,  McAl tes¬ 
ter,  1980,  DeKleer,  196b)  is  not  adequate  to  do  all  of  the  work  we  need  such  a  system  to  do.  In  particular.  In  addition  to  Its 
standard  bookkeeping  r>, Elions,  such  a  system  will  need  strategies  or  policies  to  follow  In  making  decisions  about  how  to 
make  the  world  cons  Is  mm  when  a  condition  check  falls,  or  will  need  to  interact  with  a  ree  sorter  that  can  make  such  deci¬ 
sions.  While  it  Is  standard  tor  a  truth  maintenance  system  to  retract  decisions  that  are  Inconsistent  and  to  propagate  those 
retractions  as  far  as  it  nueds  to,  in  the  problem  solving  situation  we  are  looking  at,  it  is  often  more  advantageous  to  try  to 
satisfy  constraints  in  a  d><mrent  way  (e.g.,  to  replace  a  retracted  value  with  another  that  satisfies  the  necessary  constraints). 

Hammond  (1986)  takes  the  complexity  out  of  this  Issue  by  having  the  reasoner  explicitly  try  to  avoid  mistakes  In  one 
of  Its  early  planning  steps.  The  advantange  of  this,  of  course,  Is  that  after  potential  mistakes  are  discovered,  the  problem 
solver  need  only  keep  mem  m  mind  during  the  remainder  of  problem  solving  rather  than  having  to  deal  with  new  Issues  and 
possible  change  of  focus  part  of  the  way  through.  There  is  thus  no  need  for  the  complexity  of  a  truth  maintenance  system. 
On  the  other  hand,  the  reasoner  can  only  avoid  those  mistakes  that  can  be  foreseen  at  the  onset  of  problem  solving,  but 
cannot  avoid  mistakes  i'>at  tne  problem  solver  might  not  be  able  to  anticipate  until  late  In  the  problem  solving. 
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Carbonell  (1986)  deals  with  this  Issue  In  yet  another  way.  His  work  assumes  that  each  old  problem  is  stored  as  a 
sequence  of  reasoning  steps,  and  that  any  time  two  problems  are  similar  in  their  set  of  steps,  the  second  Is  stored  on  with 
the  first,  branching  from  it  at  the  place  they  begin  to  be  different.  Thus,  once  the  case-based  reasoner  Is  reminded  of  a  pre¬ 
vious  case,  It  has  available  to  It  all  of  the  cases  that  have  been  solved  by  the  same  Initial  set  of  steps  as  the  one  it  is 
currently  trying  to  solve.  This  means  that  at  each  decision  point  in  the  problem  solving,  each  of  the  previous  decisions  that 
have  been  made  are  available  along  with  their  justifications.  Reasoning  similar  to  that  described  In  this  paper  happens  to 
evaluate  which  of  the  possibilities  Is  appropriate  for  the  new  case.  The  advantages  of  this  method  are  similar  to  the  advan¬ 
tages  in  Hammond's  method:  the  problem  solver,  In  general,  never  needs  to  refocus  Itself,  and  there  ie  no  need  for  a  truth 
maintenance  system.  The  major  disadvantage,  however,  Is  that  once  Carbonell's  problem  solver  finds  a  set  of  previous 
esses  that  are  similar  to  its  current  one,  it  le  wedded  to  that  set,  and  no  other  cases  that  might  be  similar  along  a  different 
set  of  dimensions  can  contribute  to  the  problem  solving. 


7.  Summery 

Previous  problem  solving  failures  can  be  a  powerful  aid  In  helping  a  problem  solver  to  become  better  over  time. 
When  a  previous  case  <n  which  an  error  was  made  is  recalled.  It  flags  the  potential  for  a  similar  mistake  and  the  reasoner 
considers  whether  the  same  potential  for  error  exists  in  the  new  case.  The  direct  result  of  this  Is  that  reasoning  ie  directed 
to  that  part  of  the  current  problem  that  was  responsible  for  the  previous  error,  sometimes  changing  the  problem  solver's 
focus.  Evaluation  of  the  potential  for  error  In  the  current  case  may  require  the  problem  solver  to  gather  knowledge  It 
doesn't  already  have,  another  way  focus  might  be  redirected.  A  case  with  an  error  may  also  suggeet  a  correct  solution  for 
the  new  case.  The  combination  of  these  helps  the  problem  solver  to  avoid  repeating  mistakes  and  suggests  shortcuts  In 
reasoning  that  avoid  the  Inal  and  error  of  previous  cases. 
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